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Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 2 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 1 1/8/05 . 
2a)D This action is FINAL. 2b)K This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) £3 Claim(s) 1-16 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) E3 Claim(s) 1-16 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1 .121 (d). 
1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)Q Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)D All b)Q Some * c)D None of: 

1 Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 

1 . This action is responsive to the RCE amendment, and Interview Summary filed on 6/20, 
and 1 1/8/2005 respectively. 

This action is made Non-Final. 

2. In the amendment, claims 15-16 have been added. Claims 1-16 are pending in the case. 
Claims 1 , and 8 are independent claims. 

Drawings 

3. The drawings filed on 10/19/2001 have been approved by the examiner. 

Claim Rejections - 35 USC § 102 

4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

5. Claims 1-6, and 8-13 are rejected under 35 U.S.C. 102(e) as being anticipated by Ma et 
al, hereinafter Ma (Pat.# 5,909,805 B2, 6/21/2005, filed on 1/3 1/2001). 
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Regarding independent claim 1, Ma discloses scanning a document containing printed 
text, and handwritten annotations — capturing an original image of a document - (col. 3, lines 
57-62, fig.l). 

Moreover, Ma discloses separating annotations from printed text, and the detection of the 
handwritten annotations in the document — detecting the annotations which were made to the 
document before or prior to capture — (col. 4, lines 3-1 1, fig.l). 

Furthermore, Ma discloses the saving of the extracted handwritten annotations into 
memory — generating a summary of a document by extracting portions of the image document 
identified by the detected annotations, the summary including only the extracted portions of the 
document and being generated as a separate electronic image document that is different from the 
original image -- (col. 7, lines 52-61, fig.7-8). 

Regarding claim 2, which depends on claim 1, Ma discloses the saving of the extracted 
handwritten annotations from the scanned document, into memory — generate a summary of the 
same document as that on which the annotations are detected — (col. 7, lines 52-61, fig.7-8). 

Regarding claim 3, which depends on claim 1, Ma discloses the saving of the extracted 
handwritten annotations from the scanned document, into a new document in memory — generate 
a summary of a different document as that on which the annotations are detected — (col. 7, lines 
52-61, fig.7-8). 

Regarding claim 4, which depends on claim 1, Ma discloses the storage of extracted text 
from the scanned document, which contains the handwritten annotations, to serve as an original 
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document — capture an image of a second document to be summarized based on detected 
annotations from a first document (col. 8, lines 1-30, 48-67, col.14, lines 16-45, fig.l, 4). 

Regarding claim 5, which depends on claim 1, Ma discloses the generation of a region of 
bounding boxes, in the scanned document, used for extracting the handwritten annotations — 
image region associated with a detected annotation - (col. 3, lines 57-col.4, line 1 1, fig. 1, 3 A- 
B). 

Regarding claim 6, which depends on claim 5, Ma discloses the generation of a region of 
bounding boxes of sentences for which the annotations have been written, in the scanned 
document, and which are used for extracting the handwritten annotations — image region 
associated with a detected annotation, the image region represents a sentence in the document 
image to provide context for the identified annotation — (col. 3, lines 57-col.4, line 11, fig.l, 3 A- 
B). 

Claims 8-13 are directed towards a method for implementing the system found in claims 
1-6 respectively, and therefore are similarly rejected. 

Claim Rejections - 35 USC §103 
6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art 
are such that the subject matter as a whole would have been obvious at the time the invention was made to 
a person having ordinary skill in the art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 
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7. Claims 7, and 14-16 are rejected under 35 U.S.C. 103(a) as being unpatentable over Ma, 
in view of Kurosawa et al, hereinafter Kurosawa (Pat. # 6,751,779 Bl, 6/15/04, filed on 
3/20/2000). 

Regarding claim 7, which depends on claim 1, Ma discloses the saving of the extracted 
handwritten annotations from the scanned document, into a new document in memory (col. 7, 
lines 52-61, fig.7-8). Ma fails to explicitly disclose: a summary comprising portions which are 
selectively expandable to increase the information in that portion of the summary. However, 
Kurosawa teaches the inserting a series of characters located in document lines into a document 
(col.6, lines 40-67). It would have been obvious to a person of ordinary skill in the art at the time 
of the invention to combined Mahoney, and Kurosawa, because Kurosawa teaches the reducing 
of burdens put upon an editor of a document, by using simple operations (col. 1, lines 59-67, and 
coL2, lines 28-53). 

Claim 14 is directed towards a method for implementing the system found in claim 7, and 
therefore is similarly rejected. 

Regarding claim 15, which depends on claim 1, Ma discloses the saving of the extracted 
handwritten annotations from the scanned document, into a new document in memory (col. 7, 
lines 52-61, fig.7-8). Ma fails to explicitly disclose: the summary includes expandable detail 
levels. However, Kurosawa teaches the inserting a series of characters located in document lines 
into a document, either by going over, or staying within a certain range — expandable detail 
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levels (col.6, lines 40-67). It would have been obvious to a person of ordinary skill in the art at 
the time of the invention to combined Mahoney, and Kurosawa, because Kurosawa teaches the 
reducing of burdens put upon an editor of a document, by using simple operations (col. 1, lines 
59-67, and col.2, lines 28-53). 

Claim 16 is directed towards a method for implementing the apparatus found in claim 15, 
and therefore is similarly rejected. 



Response to Arguments 
8. Applicant's arguments with respect to claims 1-14 have been considered but are moot in 
view of the new ground(s) of rejection. Applicants submit that Mahoney does not teach or 
suggest extracting portions of the document and generating a summary including only the 
extracted portion of the document, the summary being separate from the original image, as set 
forth in claims 1 and 8 (pages 5-7). Applicants are directed to the rationale set forth above 
regarding this newly added amendment. 

Regarding claims 6-7, and 13-14, Applicants submit that the teachings of Kurosawa do 
not remedy, the deficiencies of Mahoney (page 8). Applicants are directed to the rationale set 
forth above regarding this newly added amendment. 

Newly added claims 15-16, whose status was erroneously labeled as "original" (RCE 
amendment filed on 6/20/2005), have been rejected herein, as proposed on interview held on 
10/24/2005. 
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Conclusion 

I. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Cesar B. Paula whose telephone number is (571) 272-4128. The examiner 
can normally be reached on Monday through Friday from 8:00 a.m. to 4:00 p.m. (EST). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Stephen Hong, can be reached on (571) 272-4124. However, in such a case, please 
allow at least one business day. 

Information regarding the status of an application may be obtained from the Patent 

Application Retrieval (PAIR) system. Status information for published applications may be 

obtained from either Private PAIR or Public PAIR. Status information for unpublished 

applications is available through Private PAIR only. For more information about the PAIR 

system, go to http://portal.uspto.gov/external/portal/pair . Should you have any questions about 

access to the Private PAIR system, please contact the Electronic Business Center (EBC) at 866 

217-9197 (toll-free). 

Any response to this Action should be mailed to: 

Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 
Or faxed to: 

• (571)-273-8300 (for all Formal communications intended for entry) 

CESAR RAULA 
PRIMARY EXAMINER 

11/15/05 



